R Exercises - Religion and babies

Download Data Files

---

In these exercises we will see the power of the libraries ggplot2 and plotly to make sense of statistical data. The goal is to reproduce the moving chart that you can see in this video from Hans Rosling – I invite you to watch his other videos, they are quite enlightening and inspiring:

For this, we will need to gather the data:

• From Gapminder, data per country and per year from 1800 to 2018:
  • The children per woman total fertility
  • The income per capita
  • The total population
• From the PEW research center, data per country:
  • The religious composition

---

1 Data handling

The first thing to do is to load and regroup all these datasets into a single one.

1. Load the tidyverse library and, using read_csv(), load the 4 datasets in 4 separate tibbles called children, income, pop and religion.

library(tidyverse)
library(readxl)
children <- read_csv("Data/children_per_woman_total_fertility.csv")
income   <- read_csv("Data/income_per_person_gdppercapita_ppp_inflation_adjusted.csv")
pop      <- read_csv("Data/population_total.csv")
religion <- read_csv("Data/religion.csv")

2. To reproduce the chart on the video, we need to determine the dominant religion in each country. In the religion dataset, add a column Religion that will give the name of the dominant religion for each country. For this, you might want to use this method that returns the name of the column containing the maximum of each row of a table:

DF <- tibble(V1=c(2,8,1),V2=c(7,3,5),V3=c(9,6,4))
DF

## # A tibble: 3 × 3
##      V1    V2    V3
##   <dbl> <dbl> <dbl>
## 1     2     7     9
## 2     8     3     6
## 3     1     5     4

names(DF)[max.col(DF)]

## [1] "V3" "V1" "V2"

DF <- religion %>% select(Buddhists:Unaffiliated)
religion <- religion %>% 
        mutate(Religion=names(DF)[max.col(DF)])

3. Using pivot_longer(), make all datasets tidy.

• children should now contain 3 columns: Country, Year and Fertility.
• income should now contain 3 columns: Country, Year and Income.
• pop should now contain 3 columns: Country, Year and Population.

We will only consider data from 1800 to 2018. Example of syntax using the pipe operator %>%:

DF <- read_table("name  2010  2011  2012  2014
Kevin  10    11   12   123
Jane   122   56   23   4
"
)
DF

## # A tibble: 2 × 5
##   name  `2010` `2011` `2012`
##   <chr>  <dbl>  <dbl>  <dbl>
## 1 Kevin     10     11     12
## 2 Jane     122     56     23
## # … with 1 more variable:
## #   2014 <dbl>

DF %>% 
    select(name, '2010':'2012') %>% 
    pivot_longer(col=-name,
                 names_to="Year", 
                 values_to="Score",
                 names_transform=list(Year = as.numeric))

## # A tibble: 6 × 3
##   name   Year Score
##   <chr> <dbl> <dbl>
## 1 Kevin  2010    10
## 2 Kevin  2011    11
## 3 Kevin  2012    12
## 4 Jane   2010   122
## 5 Jane   2011    56
## 6 Jane   2012    23

The line names_transform=list(Year = as.numeric) is here to convert the character year values to numerical values.

children <- children %>% 
                pivot_longer(col=-Country, 
                             names_to="Year", 
                             values_to="Fertility",
                             names_transform=list(Year = as.numeric))
income   <- income %>% 
                select(Country, '1800':'2018') %>% 
                pivot_longer(col=-Country, 
                             names_to="Year", 
                             values_to="Income",
                             names_transform=list(Year = as.numeric))
pop      <- pop %>% 
                select(Country, '1800':'2018') %>% 
                pivot_longer(col=-Country, 
                             names_to="Year", 
                             values_to="Population",
                             names_transform=list(Year = as.numeric))

4. Now we want to combine all these datasets into a single one called dat, containing the columns Country, Year, Population, Religion, Fertility and Income. Look into the inner_join() function of the dplyr library (which is part of the tidyverse library). For the religion dataset, we will consider that the proportions of 2010 are representative of all times.

• So play with the religion dataset so that it contains only two columns, Country and Religion, the data being filtered from the original religion dataset for the year 2010.
• Join the 4 datasets into one called dat.

dat <- inner_join(children, income) %>%
        inner_join(pop) %>%
        inner_join(religion %>% 
                    filter(Year==2010) %>% 
                    select(Country, Religion) # that's the critical part
                  )
# write_csv(dat, "Data/dat.csv")

You should end up with a dataset like this one:

## # A tibble: 37,887 × 6
##    Country   Year Fertility Income
##    <chr>    <dbl>     <dbl>  <dbl>
##  1 Afghani…  1800         7    603
##  2 Afghani…  1801         7    603
##  3 Afghani…  1802         7    603
##  4 Afghani…  1803         7    603
##  5 Afghani…  1804         7    603
##  6 Afghani…  1805         7    603
##  7 Afghani…  1806         7    603
##  8 Afghani…  1807         7    603
##  9 Afghani…  1808         7    603
## 10 Afghani…  1809         7    603
## # … with 37,877 more rows, and 2
## #   more variables:
## #   Population <dbl>,
## #   Religion <chr>

In case you struggled to get there, download the archive with the button at the top and get the dat tibble with dat <- read_csv("Data/dat.csv").

Now our dataset is ready, let’s plot it.

2 Plotting

1. Load the library ggplot2 and set the global theme to theme_bw() using theme_set()

library(ggplot2)
theme_set(theme_bw())

2. Create a subset of dat concerning your origin country. For me it will be dat_france

dat_france <- dat%>%filter(Country=="France")

3. Plot the evolution of the income per capita and the number of children per woman as a function of the years, and make it look like that (notice the kinks during the two world wars):

ggplot(data=dat_france, aes(x=Year, y=Income))+
    ggtitle("Household income in France")+
    xlab("Year")+
    ylab("Household income per capita per year [constant $]")+
    annotate("rect", xmin=1914, xmax=1918, ymin=-Inf, ymax=Inf, alpha=.3)+
    annotate("rect", xmin=1939, xmax=1945, ymin=-Inf, ymax=Inf, alpha=.3)+
    geom_point(alpha=0.2, size=5)+
    geom_smooth()

ggplot(data=dat_france, aes(x=Year, y=Fertility))+
    ggtitle("Fertility in France")+
    xlab("Year")+
    lims(y=c(0,5))+
    ylab("Children per woman")+
    annotate("rect", xmin=1914, xmax=1918, ymin=-Inf, ymax=Inf, alpha=.3)+
    annotate("rect", xmin=1939, xmax=1945, ymin=-Inf, ymax=Inf, alpha=.3)+
    geom_line(size=2, color="red")

4. Create a subset of dat containing the data for your country plus all the neighbor countries (if you come from an island, the nearest countries…). For me, dat_france_region will contain data from France, Spain, Italy, Switzerland, Germany, Luxembourg and Belgium.

dat_france_region <- dat%>%
        filter(Country %in% c("France", "Spain", "Italy", "Switzerland", "Germany", "Luxembourg", "Belgium"))

5. Plot again income and fertility as a function of the years, but add a color corresponding to the country and a point size to its population:

ggplot(data=dat_france_region, aes(x=Year, y=Income, col=Country, size=Population))+
    ggtitle("Household income in France and its region")+
    xlab("Year")+
    ylab("Household income per capita per year [constant $]")+
    annotate("rect", xmin=1914, xmax=1918, ymin=-Inf, ymax=Inf, alpha=.3)+
    annotate("rect", xmin=1939, xmax=1945, ymin=-Inf, ymax=Inf, alpha=.3)+
    geom_point(alpha=0.5)

ggplot(data=dat_france_region, aes(x=Year, y=Fertility, col=Country, size=Population))+
    ggtitle("Fertility in France and its region")+
    xlab("Year")+
    lims(y=c(0,5))+
    ylab("Children per woman")+
    annotate("rect", xmin=1914, xmax=1918, ymin=-Inf, ymax=Inf, alpha=.3)+
    annotate("rect", xmin=1939, xmax=1945, ymin=-Inf, ymax=Inf, alpha=.3)+
    geom_point(alpha=.5)

6. Load the library plotly and make the previous graphs interactive. You can make an interactive graph by calling ggplotly(), like that:

library(plotly)
P <- ggplot(data = dat_france, aes(x=Population, y=Income))+
        geom_point()
ggplotly(P)# add dynamicTicks=TRUE allows redrawing ticks when zooming in

7. Finally, you can add a slider to the interactive graph allowing selecting a value for another variable (just like in the video) by adding the keyword frame = in the chart’s aesthetics. So now, make the graph of the video ! (you can also add the aesthetics id=Country to show the country name in the popup when hovering on a point).

library(plotly)
P <- ggplot(data=dat, aes(x=Income, 
                          y=Fertility, 
                          frame=Year, 
                          col=Religion, 
                          size=Population,
                          id=Country))+
    geom_point(alpha=0.5)+
    ggtitle("Fertility vs. Income in the World")+
    xlab("Household income per capita per year [constant $]")+
    lims(y=c(0,8))+
    scale_x_log10()+
    scale_size(range=c(1, 15))+
    ylab("Children per woman")
ggplotly(P)